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Abstract 

The present work investigates the Lesche stability (experimental robustness), the thermodynamic 
stability, the Legendre structure of thermodynamics, and derives the Maximum Entropy distribu- 
tion of the one-parametric "nonextensive Gaussian" entropy. We show that this entropy definition 
fulfills both stability conditions for all values of its parameter (q S R). The entropy maximizer 
contains the Lambert W -function, which allows the preservation of the Legendre transformations. 
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I. INTRODUCTION 



A very important quantity in statistical mechanics is the entropy. In the last years there 
is a great effort in this field to generalize the concept of thermal equilibrium entropy, which 
is the Boltzmann-Gibbs (BG) entropy, given by 

w 

SBG = l>Wl/ft)- (!) 

i=l 

W is the total number of the accessible microstates and pi their associated probabilities. 
A variety of systems whose behavior can not be sufficiently described by the BG statistics 
caused the tendency in this direction. The candidate entropies can be categorized into 
two classes, the trace-form and the non-trace-form ones. The earlier present the structure 
YliPi^-(Pi)> where A(pt) in general can be an arbitrary function, while the latter do not. The 
entropy that dominates as a possible generalization of the BG entropy in the first class is 
the nonextensive Tsallis [l| entropy defined as 

S I = Y~ (|>? " i) ■ (2) 
and in the second class is the Renyi entropy defined as 

= — H >>/)• <3> 



Both definitions in the limit q — 1 tend to Eq. (JTJ). In contrast to the BG entropy, whose 
maximization, according to the Maximum Entropy (MaxEnt) principle, leads to exponential 
distributions, the two latter entropy definitions may also lead to power-law distributions. 
With respect to the information theory Eq. (j2J) and Eq. ([3$ can be considered as a limit of 
the two-parametric Sharma-Mittal (SM) entropy |3|, which is given by 



qSM 
d{ r ,q} 
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From Eq. (j4j) one can see that for r = q the SM entropy reduces to the Tsallis one, and for 
q — 1 this reduces to the Renyi one. 

However, for r = 1 the Sharma-Mittal entropy contains yet a third choice of a general- 
ized entropy, which combines the nonextensivity of Tsallis and the non-trace-form of Renyi 



entropy 

= ^ (f[ P t 1)Pi - l) = ^ (e<^*» - l) =: Sf , (5) 

The authors in Ref. 4| suggested to call Eq. ([5]) "nonextensive Gaussian" (NeG) en- 
tropy. One of these authors, Frank, in Ref. [5| used this definition to solve a nonlinear 
Fokker-Planck equation which describes an Ornstein-Uhlenbeck process, in order to obtain 
analytical expressions for the transition probability densities. In the present article we shall 
keep this denomination. 

We can easily see that the main difference of the nonextensive Gaussian entropy to the 
Renyi and Tsallis entropy is that the probability functional is a product of a combination of 
probabilities instead of sum and hereafter clearly distinguishes from the trace-form entropies. 
Another point is that the entire probability functional is raised to a power, in contrast to 
the probability functionals in Eq. (TS]) and Eq. ([3]) where every state-probability separately 
is raised to a power. Written in a different way one can observe that NeG entropy contains 
the entire structure of the BG entropy. 

The purpose of the current work is to explore some statistical properties of the nonexten- 
sive Gaussian entropy and to present the connection to thermodynamics, in order to complete 
the study of all three limits, of the Sharma-Mittal definition, which lead to independent en- 
tropy structures. We show that Eq. ([5]), satisfies the nonextensive thermodynamic stability 
condition and the Lesche stability criterion. The fulfillment of both conditions is valid for all 
q G R. Thus it could be also a good alternative representative of generalized non-trace-form 
entropies in statistical thermodynamics. We also derive the maximum-entropy probability 
for Sg and present the connection to the thermodynamical structure. 

One can obtain the Tsallis entropy in a heuristic way by replacing the logarithm in the 
BG entropy with a generalized one. Here we present a heuristic way to obtain the entropy in 
Eq. §5§ by generalizing also the BG entropy using actually the same generalized logarithmic 
function. In an integral form the BG entropy can be written as 



S B g = I — , with f(pi) = exp 
x 
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ln(l/pi 
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There are two possible ways to generalize the BG entropy using the concept of a generalized 
logarithmic function (see Section |V]). The one leads to the Tsallis entropy and the other 
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For equal probabilities p$ = l/W, both and Sj tend to 
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which is the generalized logarithm introduced by Tsallis and coworkers p]. One can verify 



that the additivity rule for S^f is the same as in the case of Tsallis entropy, namely 
S^(A + B) = S?(A) + S?(B) + (1 - g) S?(A)S?(B). 



(9) 



Under the concept of stability of a state functional [7j, or "experimental robustness" 
as Tsallis proposed in Ref. [Si in order to avoid confusions with the thermodynamic sta- 
bility (see Section IHIj) , we understand the following: by making a measure, we obtain a 
distribution of probabilities {pi} i=1 2 ... w Repeating the same experiment we obtain a new 
distribution of probabilities {p'i} i=1 2 ... w which ma Y be slightly different from the previous 
one. Now, if we use a statistical entropy S, then we expect that its value should not change 
dramatically for these two slightly different distributions {Pi} i=12 ... w and {p'i} i=12 ... w - 
Then the entropy S is stable or experimentally robust and is of physical relevance. The 
essence of this kind of stability lies in the existence of an entropy associated observable. 
Lesche in 1982 [9] formulated a condition (Lesche stability), which reflects the property of 
experimental robustness, as follows: 

S(p) - S(p>) 



(Vs>0) (38 £ >0) [\\p-p\k5, 



< e 



(10) 



for any value of W, where = £) i=1 1^1 an d S'max is the maximum value of S. In the 

same work he showed that Shannon entropy is stable, while the Renyi entropy does not 
fulfill this condition for q ^ 1. After this, several entropy definitions have been explored 
with regard to this criterion. Some of these, which passed this test, are the Abe entropy lOj, 
Tsallis entropy [U[ and Kaniadakis /t-entropy 12|. Common property of these entropies 
is their trace-form state functional. It is striking that non of the non-trace-form examined 
entropies like Renyi, Landsberg-Vedral and escort entropy fulfills the Lesche criterion. 



Another very important condition that an entropy definition has to satisfy, is the ther- 
modynamic stability condition, which is equivalent to the positivity of the heat capacity 
C := OU/dT = [-T 2 {d 2 S BG /dU 2 }}-\ U is the internal energy and T := (dS-Bc/dUy 1 the 
temperature. It is well known that in the case of BG entropy the thermodynamical stability 
condition (TSC) and concavity are equivalent to each other: 

%^<o. (n, 

The physical background of Eq. (fTTT) is based on the combination of the entropy maximum 
principle and the additivity of ([1]). Thus the fulfillment of the condition (fTTl) is a very 
important point in statistical thermodynamics. However, the demand of the concavity for 
a nonextensive entropy definition does not suffice to preserve the thermodynamic stability 
0, Q] • This can be easily understood since the total entropy of two composed subsystems 
is not the sum of the partial entropies of each subsystem. 

In Section [IT] we present the proof of the fulfillment of the Lesche stability criterion. In 
Section II II I we derive in two different ways the thermodynamic stability condition for the 
nonextensive Gaussian entropy and show that this is satisfied by the latter. In Section IIVI 
we present the connection of to thermodynamics. In the final section we draw our main 
conclusions. 



II. LESCHE STABILITY 



The Lesche stability condition reflects the reproducibility of the values of any observable 
quantity. Here we prove this condition with regard to S®. The exponential form of the 
Sy— state functional makes difficult, if not impossible, the usage of the formalism in Ref. 

In order to overcome this problem we shall try to find a probability functional which 
is greater than the expression exp[(l — qOSbg] an d makes possible the application of the 
formalism we discussed above. We follow the next steps. 

The Young Inequality for x, y, p\, p 2 > and pi + p 2 = 1 is expressed as 

xy ^pix l/pi +p 2 y 1/p2 - (12) 
By substituting x = p^ 1 ^ 9 and y = p 2 2 ^ q we rewrite the last equation as 

pf^pf^ ^Pl+Pl, (?€»)■ (13) 
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Now, if we use a finite set of variables {xj}i=i,...,pv, Eq. (TT3T) can be extended as follows 

vi(q-l) vw(q-l) 
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From Eq. (1141) one can observe two things. First, after applying the logarithmic function 
on both sides, we obtain the known inequality 
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Second, we recall that a convex function satisfies the relation 

w \ w / w 
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For 0(x) = exp (a;), g(xj) = In (x{) and Xj = p\ 1 we obtain 



3 (1-?)S BG 
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Eq. f|T7|) . because of Eq. ffT4"l) . is always valid. Accordingly, the expression exp [(1 — q)S-QG\ 
is a convex function for all g's and thus its second derivative is positive. Then we get the 
relation 



'l-qf l dS *M 



+ (1-9) 



d 2 S BG (p) 



> 0, (qe 
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dp J ^' dp 2 

Eq. ([TBI is interesting for q < 1 since the first additive term is positive and the second 
negative. For q > 1 the validity of ({TBI) is trivial. By applying in Eq. (fl~4"I) the exponential 
function and after making some manipulations we can easily show that 
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Taking into account Eq. (jSj) we extend Eq. (fT9"j) to 
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In Ref. [llj it has been proved that the Tsallis entropy is Lesche stable for q > 0. Thus 
from Eq. (120]) we obtain that the nonextensive Gaussian entropy is also Lesche stable for 



q > 0. Now, we still have to check this criterion for negative values of q, since for q < the 
exponential state functional does not lead to any singularity, as in the case of the trace-form 
entropies (see Eq. §7$). But this is already done, because the proof steps in Ref. [11] can be 
extended without need of modifications into two regions, one for q < 1 and one for q > 1. 
Thus we finally obtain 



S?(P) - 5?(P0 
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(g>l) 



(21) 



in the limit W — ► oo. Therefore, taking \\p — p'\\ 1 < 5 £ ^ e 1 / 9 for g < 1 or ||p — p'\\ 1 < 5 £ ^ 
e/g for g > 1 we see that the condition ( jTUl) is satisfied. Consequently the nonextensive 
Gaussian entropy is Lesche stable for all q G R. 



III. THERMODYNAMIC STABILITY 



It is well known that BG entropy is composable and additive. From the entropy maximum 
principle and the additivity of S B g one can derive the thermodynamic stability condition, 
which is expressed as follows: 



d 2 S BG (U) 
dU 2 



£ 0. 



(22) 



Let us consider an isolated system composed of two identical subsystems in equilibrium. The 
total entropy would be Sbg{U, U) = 2Sbg(U). Transferring now an amount of energy AU 
from the one subsystem to the other the total entropy changes as Sbg(U + AU, U — AU) = 
Sbg{U + AU) + 5bg(^ — AU). According to the maximum entropy principle the final value 
of the entropy can not be larger than the initial one, consequently 



2S , BG (£0 > S BG (U + AU) + S BG (U - AU). 



(23) 



This is the thermodynamic stability condition for the BG entropy. In the limit AU — > Eq. 
(I23p tends to Eq. ( l22i) . However, in the case of nonextensive entropies the concavity condi- 
tion (1221) does not correspond to thermodynamic stability. Considering again the maximum 
entropy principle (S(U, U) ^ S(U + AU, U — AU) for any entropy S) as in Eq. ( 1231) and 
taking this time into account the pseudo- additivity Eq. (jUJ), the TSC of is written as 
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2Sf (U) + (1 - g) {S* (Ut > (U + AU) + (U - AU) 



In the limit AU 



+ (1 - g) S g G (C/ + AU) (U - AU) . 
this condition can be rewritten in the differential form 
, ,. d z S^(U) (dS^(U)\ 2 



(24) 



d 2 s^{u) 



dU 2 



dU 2 



dU 



(25) 



The TSC ( 125]) is valid for every entropy, whose composability rule is given by Eq. 
Replacing Eq. (jSJ) in Eq. (1251) we obtain for the nonextensive Gaussian entropy 



3 2(i- g )s BG (t/) d 2 *W^) 
at/ 2 



< 0. 



(26) 



Since the exponential term is always positive and the second derivative of the BG entropy 
is always negative, Eq. ( 1261) is satisfied for every q. Accordingly, Sff is thermodynamically 
stable for all values of q G R. A different way to obtain the TSC specific for the nonextensive 
Gaussian entropy is the condition Eq. ( 1221) itself, since the BG entropy can be written as 

1 



S 



BG 



l-q 



ln[l 



q)s, 
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Then from both Eqs. ( 1221) and ( 1271) we obtain 
d 2 S^(U) 



X x 



<9f/ 2 



^ 0, 
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at/ 2 

* = [i + (i - ?) s?(t0]' 

The first multiplicative term X is always positive and accordingly Eq. (1281) reduces to Eq. 
(1251). 



IV. MAXENT DISTRIBUTIONS 

In this section we want to explore the structure of the distributions which maximize 
under appropriate constraints. For the internal energy U the constraint we shall use is the 
so called escort mean value [15J expressed as 

(U) g = (29) 



where Ue describes the energy levels of the system under consideration. We consider now the 
generalized canonical ensemble described by the entropy under the energy constraint fl29|) 
and the normalization constraint Yle=iPi = 1- To derive the maximum-entropy (MaxEnt) 
distribution of this ensemble, we introduce the Lagrange multipliers a and /3 and the function 



W) = 5 fl G (W) + « 



We require that the variation SI vanishes for all perturbations Spi of the MaxEnt distribution, 
accordingly 

*SM) = _ e (,-D(M.)) (1 + Hpi)) _ Pq J§l_ f Uf _ {U) \ _ a 1 o (31) 
d Pi 22t=iPi V J 

For q — > 1 (I3T]) reduces to the usual condition for Shannon's maximizer. We multiply now 
both sides by pi and sum over i. Taking into account the normalization condition we obtain 

a = - (1 + (ln(p/)» e (9 - 1)(ln(w)) (32) 

Replacing result ( l32l) in (j3~Ti) we get 

in fe) - im - <*o,) • (33) 



(ln(p £ )) a 



l + <ln(p,)) l + (ln(p,)) ^ JXijpl 
With the following three substitutions 

K =(h^)y *m=( p «-w.). ^^sirf (34) 

we receive the final form 

1 = K\n{pi) +pl 1 f3 q ne {1 - q) ^E l {q). (35) 
A possible way to solve this equation is by using the Lambert VT-function [161 ] . given as 



W{x)e w{x) = x. (36) 



Accordingly, the distribution acquires the following structure 



with Z given as 



Z = f exp(^jMM-). (38 ) 



Here we can define a new generalized exponential function 



ef(x) := 



exp 




1 -q)x ^ 



(39) 



which we call (^-exponential. Eq. ( 1391) is symmetric with respect to 1 — q and because of 
Eq. (f36l) it can be written in the following different ways: 



e£(x) 
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(40) 



-(1 — q)x 

For g = 1 the generalized exponential function in (1391) and (j4"0l) tends to the ordinary one. 

As we can see the form of the probability distribution (137|) is not very familiar and clearly 
distinguishes from the Renyi/Tsallis ones. However, in the asymptotic limit, which is, for 
Ei(q) 3> l/[(3 q (q — 1)], Eq. (1371) tends to a power-law distribution function 



Pi cc[Ei(q)]—* = [Ui-(U) q 
same as the Renyi/Tsallis maximum entropy distribution p. 
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(41) 



V. CONNECTION TO THERMODYNAMICS 



In Refs. jj]] and (17| it has been shown that the entire Legendre structure of thermody- 
namics is g-invariant with regard to Tsallis and Renyi entropy respectively. In this section 
we explore whether the Legendre structure is also invariant with respect to NeG entropy. 
Using Eq. (I4D1) we can express the Lambert function in Eq. (I3"7j) in the following two ways 

W[{q-l)P q E t {q)] = i KPl ' ^ )Pq tW . (42) 

[(l-q)\n( Pl Z) 

Accordingly, we have 

{p l Z)i- 1 f3 q E l {q) = -\n{p l Z). (43) 



By multiplying Eq. (143]) with pi and taking the sum over all i's the left hand side of Eq. 
(1431) vanishes because of the constraint Y^i=\VVJi — (U) Q YliLiPi- Then we obtain 



w 



Z = e -(MP<)) = Y[p~ p . (44) 



i=l 
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Consequently we can express the entropy SS 1 in dependence on Z as 

S? = K(Z). (45) 



With the introduction of a temperature 1/T = dS^/d (U) fl^ ]. where T is connected with 
the Lagrange multiplier (3 as (3 := 1/T, and after defining the partition function Z as 

ln g (Z):=ln 9 (Z)-/3<*7> ? , (46) 

one can show that the escort mean energy (U) q can be expressed as 

(U) q :=-^ln q (Z). (47) 

Then, the free energy F q , which is defined as 



F q :=(U) q -TS^ = (U) q -^, (48) 



can be written as 

F q = -±\n q {Z), (49) 
for the maximum entropy distribution ( l37j) . We can also verify that 

asf a(v )q & Fq 
°* •" ap ~ ap ~ 8t* • l5U) 

where C q is the generalized specific heat. In other words, the NeG entropy under the con- 
straint of the internal energy (|29|) and the normalization constraint, preserves the Legendre 
structure of thermodynamics. 

Next we shall present the relation between the generalized temperature and specific heat 
with the ordinary ones. In the BG case the temperature and the specific heat are given by 

1 dS B c 1 dT 2 <9 2 5bg (tt /m x 
By replacing the BG entropy in Eq. ( 15TT) with Eq. ( 1271) we obtain 



1 dS G 

T={l + (l-q)Sf}T q with Y'^~dU J 

c-c q ^ l -^{ l + t) Wlth c q -— T ^ 



(52) 
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These two expressions for T and C are the same with those derived for the Tsallis entropy. 



Wada in Ref . 



131 ] computed the relations in (152]) from the composition rule (Q. Accordingly, 



they are valid for every entropy that satisfies Eq. 0. 

Finally, in Eq. (j7j) we showed, that by using the g-logarithm (jSj) there two possible ways 
to generalize the BG entropy. Here we explore the essence of this result and show that 
for an arbitrary generalized logarithm the BG entropy can be generalized actually in three 
different ways. 

Therefore, we consider an isolated system composed by A" independent particles, with 
their energy levels characterized by the occupation numbers ni, n 2 , 

• • • , riw and their respective probabilities pi, p 2 , ■ ■ ■ , pw Then the number of all possible 
configurations of the particles is given by the multinomial coefficient M: 



M 



(n 1 )\(n 2 )\---(n w )\ 



N\ 



(Np 1 )\(Np 2 )\---(Np w )\ 



(53) 



In further we introduce the quantity X := M X I N . For A" — > oo and taking into account the 



relation limjv^oo AH 



■ N 



we can easily show that 



*=n^ rPi = e<in(iM 



)> 



(54) 



8=1 



Now, the BG entropy is defined in thermal equilibrium as the application of the logarithmic 
function on Eq. (154")) : 

S BG := In (X) = In [l[p;A = (In (l/ ft )> = - (In (p,)) . (55) 



v i=l 



Although all expressions in Eq. (155]) are equal, it is obvious that the replacement of a 
generalized logarithmic function L$ with 



lim Lf(a) = In (a), (a > 0), 



(56) 



and a set of parameters q := {qi}i=i } -, m , leads to different generalized entropy structures. 
These are the following: 

w 



S 



(i) 



Mn 



Pi 



s 



(2) 



(W/Pi)), S® = -(Lfa)). 



(57) 



There are three things to notice. First, the Renyi definition does not correspond to any 
of the three entropy generalizations in Eq. ( |57j) . Second, and SV have the same 
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structure . The small differences between them can be refered to a transformation with 
respect to q {(f 2 ^ — ► f(cf 3 ^))- Thus they represent actually the same quantity. Third, the 
maximization of under consideration of the constraint (1291) leads always to Lambert 
exponential distributions, independent from the choice of the g-logarithm, because of the 
following relation 

dS® _dL € (S BG ) dS BG 



dp OSbg dp 



Using the one-parametric generalized logarithm (jSJ) we identify Sq 1 ^ = S^, Sq 2 ^ = Sj and 
:( 3 ) ;o cT 



Sq is the Sj_ transformed Tsallis entropy (q — > 2 — q). 



VI. CONCLUSIONS 

We have studied some statistical properties of the nonextensive Gaussian entropy (j3J). 
is Lesche stable (or experimentally robust) for all values of q G R. We have shown that the 
Lesche stability of is a consequence of the Lesche stability of the Tsallis entropy. We found 
the same thermodynamical stability condition as in the case of Tsallis entropy with regard to 
the ordinary internal energy, using the concavity condition of the Boltzmann-Gibbs entropy, 
since can be expressed as functional of the entire «Sbg- The condition is satisfied for all 
values of q G K. We derived the distribution that maximizes the nonextensive Gaussian 
entropy. This is based on the Lambert PU-function. A new generalized (^-exponential 
function is defined. For q — 1 it returns to the ordinary one. In the thermodynamic 
limit it tends to a pure power-law function. The connection of to thermodynamics 
is presented. We showed that the Legendre structure is preserved through a convenient 
definition of a generalized partition function and the relation between the temperature and 
specific heat with the generalized ones is the same as in the case of Tsallis entropy. Finally, 
we demonstrated that by replacing the ordinary logarithm in the equilibrium Boltzmann- 
Gibbs entropy with a generalized one, we obtain three possible entropy structures, in which 
one can identify the nonextensive Gaussian entropy and the Tsallis entropy. The Renyi 
entropy, since it is not based on the concept of a generalized logarithmic function, does not 
belong to any of these three cases. 
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